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Introduction: 


This  final  report  covers  a  4  year  project  that  was  split  into  two  funding  blocks 
AOARD  Grant  09-4073  and  AOARD  11-4039.  It  is  a  joint  research  project  with  Prof 
Tom  Cronin  of  UMBC  USA  and  he  was  funded  under  AFOSR  FA9550-09- 1-0149. 
Our  two  groups  have  worked  together  for  over  two  decades  and  have  an  outstanding 
history  of  producing  new,  exciting,  and  unexpected  research  findings  and  publishing 
in  the  very  best  international  scientific  journals.  Tom  Cronin  has  provided  a  final 
report  to  cover  his  laboratory  effort  and  it  should  be  noted  that  much  of  the  following 
output  is  highly  collaborative  with  the  Cronin  lab.  Named  collaborator  Dr  Nick 
Roberts  (University  of  Bristol,  UK)  also  contributed  much  expertise  at  the  physics 
end  of  this  research.  One  of  the  success  highlights  of  this  work  has  been  that  we  have 
all  now  been  co-funded  to  continue  the  work  started  here  with  a  joint  collaborative 
project  through  AFOSR,  AOARD  and  EOARD. 

Our  respective  labs  and  students  joined  forces  to  work  in  the  field  on  polarization 
vision  at  the  Lizard  Island  Research  Station  in  Australia  on  two  occasions,  and  met  to 
exchange  ideas  with  the  vision  community  at  several  international  meetings.  All 
members  of  the  team  exchanged  visits  between  their  home  laboratories  many  times 
and  we  also  invited  a  new  collaborator,  Viktor  Gruev  of  Washington  University  (St 
Louis,  MO),  to  join  the  team  in  the  field  for  work  on  innovative  polarization  imaging 
systems.  Viktor  is  also  now  a  formal  member  of  the  team  as  a  contractor  through  the 
Cronin  lab.  Research  associated  with  this  funding  was  carried  out  at  the  University  of 
Queensland,  the  University  of  Maryland  Baltimore  County,  the  University  of 
California  at  Berkeley,  Washington  University,  Bristol  University,  the  Duke 
University  Marine  Laboratory,  Lizard  Island  Research  Station,  and  the  Marine 
Biological  Laboratory,  Woods  Hole. 

During  the  term  of  the  grant,  we  published  (or  have  in  press)  more  than  30  papers  or 
book  chapters,  many  of  which  were  primarily  supported  by  Air  Lorce  funding.  The 
work  has  been  presented  at  numerous  talks,  seminars,  and  posters  at  international 
meetings,  often  with  our  major  collaborators  as  co-authors.  Our  work  has  been 
featured  in  the  international  press,  in  ‘blue-chip-  documentaries  such  as  David 
Attenborough’s  “Lirst  Life”,  on  Radio  Lab  in  the  USA,  and  in  numerous  scientific 
blogs  and  online  journals.  A  humorous  take  on  the  ‘deadly’  mantis  shrimp,  inspired 
largely  by  our  efforts,  can  be  found  at: 

The  Oatmeal  -  http://theoatmeal.com/comics/mantis  shrimp.  Courtesy  of  these  guys, 
we  even  have  a  bumper-sticker: 


The  ultimate  goal  of  this  research  was  less  to  excite  the  media  and  more  to 
understand  polarization  vision,  polarization  communication  and  polarization 
camouflage  (information  transfer)  in  marine  animals,  with  a  view  to  using  what  we 
learn  in  technological  applications.  Spatial  navigation,  sensing  and  guidance  are 
tasks  animals  behaving  in  the  real  world  accomplish  every  day  and  some  of  this  is 
achieved  using  polarized  light,  a  form  of  electromagnetic  radiation  that  humans  are 
not  capable  of  accessing  without  resorting  to  technology  such  as  filters,  cameras  and 
specialized  sensors.  Our  aim  is  to  use  the  power  of  biological  design  in  a  realm  of 
vision  to  which  we  are  only  now  becoming  dimly  aware. 


Objectives  (as  stated  in  the  original  proposal ) 


(1)  To  measure  and  explain  structural  properties  and  their  diversity  in  natural 
materials  that  preferentially  reflect  or  absorb  linearly  and  circularly  polarized 
light.  Our  research  has  revealed  that  certain  animals  use  very  unusual  structures  to 
control  the  reflection,  transmission,  or  absorption  of  linearly  or  circularly  polarized 
light  from  their  surfaces  or  in  their  photoreceptors.  These  structures  often  have  no 
man-made  counterparts,  and  the  optics  underlying  polarization  absorption  or 
reflection  are  poorly  understood.  In  this  project  we  will  examine  new  types  of 
natural  polarizers  and  polarization-sensitive  photoreceptors,  characterizing  their 
spectral,  ultrastructural,  and  theoretical  optical  properties. 

(2)  To  investigate  the  physiological  processing  of  polarization  information. 

One  group  of  our  focal  animal  models,  stomatopod  crustaceans,  possesses  an 
astonishingly  broad  range  of  visual  information-sensing  channels.  There  are  16 
information  input  channels  in  all:  12  are  for  the  analysis  of  color  (one  also  associated 
with  polarized  light)  plus  at  least  two  for  detecting  linearly  polarized  light  and  two 
for  circularly  polarized  light.  Understanding  how  information  is  tracked  in  this 
parallel  input  array  will  be  the  basis  for  guiding  research  into  sensor  fusion,  stimulus 
analysis,  and  post-processing  of  sensory  information.  Efficient  processing  and 
resultant  “command  decisions”  for  the  brain  to  interpret  and  act  on  are  essential  for 
these  fast-living,  combative  animals.  Using  electrophysiological  and 
neuroanatomical  studies  on  the  properties  of  neurons  in  the  visual  pathway,  we 
expect  to  discover  new  forms  of  sensory  filtering,  integration,  and  sorting.  We  now 
understand  the  basics  of  these  properties,  but  new  work  will  examine  temporal 
features  and  spatial  aspects  of  sensory  processing  with  the  goal  of  uncovering 
approaches  to  hyperacute  imaging  of  stimuli  in  both  time  and  space. 

(3)  To  examine  the  design  and  specializations  of  molecular  receptors  used  for 
visible  and  ultraviolet  polarization  sensing.  Recent  molecular  research  on 
photopigments  in  our  laboratories,  as  well  as  newly  published  information  on  the 
3-dimensional  molecular  structure  of  polarization-sensitive  visual  pigments,  will 
form  the  background  for  new  studies  on  molecular  specializations  of  visual  pigments 
and  associated  molecules  that  are  designed  for  enhanced  polarization  sensitivity  in 
both  the  visual  and  ultraviolet  spectral  ranges.  With  at  least  five  UV  photoreceptor 
classes,  stomatopods  have  a  particular  interest  in  this  spectral  region  that  we 
currently  do  not  understand.  By  working  out  the  molecular  underpinnings  of 
polarization  sensing,  we  will  gain  insight  concerning  functional  differences  among 
materials  which  could  have  application  for  fabrication  or  design. 

(4)  To  characterize  and  explain  polarization  optics  and  visual  sampling  of 
natural  stimulus  fields  in  model  organisms.  A  general  principle  of  neural 


sampling  is  that  both  pre-receptor  and  post-receptor  mechanisms  operate  in  series  to 
enhance  signal  detection.  Our  objective  here  is  to  examine  some  of  the  prefiltering 
mechanisms  used,  both  optically  and  behaviorally.  The  work  is  expected  to  involve 
a  variety  of  animals  to  explore  diverse  systems  of  managing  difficult  environmental 
challenges.  These  systems  include  object  detection,  covert  signalling,  and 
navigation. 


Principal  Investigators,  Students  and  Post-Doctoral  Researchers: 


Justin  Marshall 

-  e-mail  address  :  Justin.marshall@uq.edu.au 

-  Institution  :  The  University  of  Queensland 

-  Mailing  Address  :  Queensland  Brain  Institute,  The  University  of  Queensland, 
St  Lucia,  Queensland  4072,  Australia. 

-  Phone  : +61  7  33651397 

-  Fax  :  +61  7  33654522 

Thomas  Cronin 

-  e-mail  address  :  Cronin@umbc.edu.au 

-  Institution  :  The  University  of  Maryland  Baltimore  County 

-  Mailing  Address  :  Biological  Sciences,  UMBC,  1000  Hilltop  Circle,  Baltimore 
MD  21250,  USA 

-  Phone :  +1  4104553449 

-  Fax  : +1  4104553875 


The  personnel  involved  in  and  supported  by  this  project  are  summarized  below: 


Justin  Marshall  PI 

Tom  Cronin  PI 


Nick  Roberts  (UK)  Supporting  collaborator 

Nader  Engheta  Supporting  collaborator 

Viktor  Gruev  Supporting  collaborator 


Shout  Chiou 
Martin  How 
Shelby  Temple 
Vincenzo  Pignatelli 


PostDoc,  salary  supported,  Moved  December  2011 
PostDoc,  salary  supported 
PostDoc,  research  supported 
PostDoc,  research  supported 


Hanne  Thoen 
Chris  Talbot 
Wen-Sung  Chung 
Yi-Hsin  Li 
Mathilda  Bue 
Rachel  Templin 
Mickey  Pascoe 
Rachel  Templin 


PhD,  salary  supported  50%  (started  April  2011) 
PhD,  research  supported  50% 

PhD,  research  supported  30% 

PhD,  research  supported  30% 

Undergraduate  Honours  Awarded  2011 
Undergraduate  Honours  Awarded  2011 
Undergraduate  Honours  Awarded  2012 
PhD,  research  supported  Awarded  2012 


Where  possible,  we  have  sought  to  build  the  capacity  of  the  grant  through  awards  for 
students,  travel  and  personnel  costs.  Example  from  the  above  list  include  PhD 
awards  from  Norway,  Australia  and  Taiwan. 


Summary  of  achievements: 


a)  The  development  of  a  behavioural  screening  technique  for  polarization 
sensitivity  in  any  animal  (trialed  on  crustacean,  cephalopods,  fish  and  turtles). 

b)  Demonstration  of  polarization  sensitivity  ten  times  more  acute  than 
previously  documented  in  cephalopods  (cuttlefish  and  octopus)  and 
crustaceans  (mantis  shrimps  and  crabs).  This  opens  a  potentially  new  chapter 
in  polarization  communication  and  camouflage. 

c)  Electrophysiological  characterization  of  linear  polarization,  circular 
polarization  and  colour  photoreceptors  in  3  species  of  mantis  shrimp 
(stomatopod).  This  includes  confirmation  of  elliptical  encoding  in  2  species, 
again  suggesting  a  covert  communication  language? 

d)  Behavioural  acuity  threshold  of  linear  polarization  in  a  stomatopod 
characterized  and  has  contributed  to  overall  model  of  information  processing 
in  the  system. 

e)  Anatomical  basis  of  circular  polarization  characterized  in  6  stomatopod 
species. 

f)  Modeling  of  ideal  Va  wave  retardation  advanced  using  biological  parameters 
as  input  -  it  is  this  area  that  has  the  highest  chance  of  practical  application 
through  data-storage  and  nanotechnological  biomimetics. 

g)  Demonstration  of  new  forms  of  linear  and  circular  polarization  reflection  in 
several  stomatopod  species. 

h)  Characterisation  of  the  polarization  reflection  properties  of  marine  creatures 
other  than  cephalopods  and  stomatopods  has  begun  with  over  20  species  of 
fish  so  far. 

i)  Initial  work  begun  during  this  grant,  and  to  be  continued,  with  new  award,  to 
develop  custom  made  CCD  chip  polarization  cameras  (with  Viktor  Gruev,  U 
Washington). 


Example  Results 


1  -  Behavioural  tests:  experiments  with  LCD  polarisation  monitors 
(achievements  b  and  d) 

The  news  concept  behind  this  behavioural  screening  technique  is  as  follows: 

Conventional  liquid  crystal  display  (LCD)  computer  monitors  are  based  on  the 
manipulation  of  linearly  polarised  light  by  the  electrical  activation  of  liquid  crystal 
filters.  Light  passes,  first  through  a  vertically  oriented  linear  polaroid  filter,  then 
through  an  LCD  array,  and  finally  through  a  second  horizontally  oriented  polaroid 
filter.  Without  electrical  activation  the  LCD  layer  causes  the  e-vector  of  the  incoming 
vertically  polarised  light  to  be  rotated  by  90  degrees,  allowing  most  of  it  to  be 
transmitted  through  the  second  horizontally  oriented  polaroid  filter.  However,  when 
electrically  activated,  the  liquid  crystals  reorient  themselves  so  that  the  plane  of 
polarised  light  is  rotated  to  lesser  amounts  depending  on  the  level  of  electrical 
stimulation.  This  results  in  different  amounts  of  light  being  transmitted  through  the 
second  polaroid  filter. 

It  follows  that  the  removal  of  the  second  polaroid  filter  will  produce  a 
polarisation-only  monitor,  in  which,  what  was  previously  brightness  contrast,  now 
corresponds  to  polarisation  e- vector  contrast.  In  collaboration  with  Drs.  Nick  Roberts 
and  Shelby  Temple  (University  of  Bristol)  we  adapted  several  standard  computer 
monitors  in  this  way  to  test  the  response  of  various  species  of  marine  organism  to 
polarised  light  stimuli  (Fig.  1). 


Polarisation  vision  in  the  cuttlefish  Sepia  plangon 

Cuttlefish  from  the  waters  near  the  UQ  fieldwork  station  on  Stradbroke  Island  were 
housed  in  glass  seawater  aquaria.  A  polarisation  monitor  was  then  placed  against  one 
side  of  the  aquarium  and  fast  looming  circular  stimuli  (equivalent  to  an  approaching 
predator)  were  presented  at  3  minute  intervals  (Fig.  1).  The  angle  of  polarisation 
contrast  was  altered  for  different  presentations,  so  that  polarisation  contrast  varied 
from  90°  to  0°.  Cuttlefish  responded  to  perceived  looming  stimuli  in  a  number  of 
ways,  including  swimming  movements,  skin  colour  and  texture  changes,  which  were 
recorded  using  digital  video  cameras.  We  developed  an  automated  system  for 
measuring  cuttlefish  responses  from  the  digital  video  sequences,  based  on  changes  in 
the  distribution  of  image  pixel  intensity  values  within  the  body  region  of  the 
cuttlefish. 


The  remarkable  result  from  this  work  is  that  these  animals  display  a  very  sensitive, 
around  1°  sensitivity  to  the  direction  of  polarised  light.  This  would  enable  them  to 
use  and  analyse  signals  from  their  world  in  the  same  way  as  we  utilise  colour  vision. 


C 


time  (seconds) 


Fig.  l.  Cuttlefish  ( Sepia  plangon )  body  patterns  as  a  behavioural  assay  for  testing  polarisation  vision. 
(A)  Schematic  of  testing  tank  and  relative  position  and  size  of  stimulus.  (B)  Body  colour  pattern 
change  showing  deimatic  (brightening)  response  to  potential  predator,  top  is  pre-stimulus  body  pattern 
bottom  is  post  stimulus  body  pattern.  (C)  Time  course  of  change  in  body  colour  pattern,  stimulus 
onset  marked  by  double  headed  arrow.  Line  follows  the  mean  change  in  intensity  value  of  pixels  on 
the  mantle. 


This  work  is  has  been  published  in  the  leading  biological  journal  Current  Biology 
The  press  release  that  accompanied  this  work  is  copied  below  and  we  had  much 
interest  from  several  mainstream  science  communication  groups  such  as  New 
Scientist  and  Discovery  channel. 


Australian  and  UK  researchers  have  made  new  findings  about  a  form  of  secret  language 
in  the  animal  kingdom  using  polarization,  a  type  of  light  that  humans  cannot  see. 

In  a  new  paper  published  in  Current  Biology,  researchers  atUQ’s  Queensland  Brain 
Institute  and  at  the  University  of  Bristol  in  the  UK  have  examined  polarization  vision 
and  its  significance  in  biological  signalling. 

They  focused  on  a  type  of  cuttlefish  (close  relative  to  octopus  and  squid]  to 
demonstrate  how  polarization  could  be  used  as  an  important  kind  of  communication  in 
the  animal  kingdom. 

The  new  paper  shows  cephalopods  such  as  cuttlefish  have  the  ability  to  see  in  many 
more  directions  of  polarized  light  than  previously  thought. 

Co-author  Professor  Justin  Marshall,  who  has  published  more  20  scientific  papers  on 
polarization,  said  humans  had  not  yet  developed  the  language  to  describe  all  the  roles 
of  polarization  in  nature. 

Professor  Marshall  said  most  people  would  be  familiar  with  the  concept  of  polarization 
through  the  use  of  polarized  sunglasses,  but  polarization  also  had  an  important 
application  in  the  detection  of  skin  cancer  in  humans,  as  a  viewing  scope  containing 
polarized  light  was  a  technology  currently  used  to  detect  melanomas. 

"Our  work  is  borrowing  from  millions  of  years  of  evolution,  so  perhaps  we  can  learn  a 
lot  from  nature  in  terms  of  better  solutions  to  the  problems  mankind  faces,"  he  said. 

It  has  been  known  for  years  that  many  animals  have  better  colour  vision  than  humans 
and  also  many  have  polarization  vision  [P-vision] .  They  literally  see  things  that  we 
can't. 

The  polarization  of  light  is  a  dimension  of  reality  invisible  to  most  people  without 
specialized  instruments. 

"Mammals  and  some  other  groups,  don't  appear  to  have  P-vision,  although  many  parts 
of  the  animal  kingdom  do,"  he  said. 


"For  example,  other  studies  have  found  that  animals  such  as  ants  and  bees  and  even 
fish  may  used  polarization  to  navigate. 


"Polarization  in  animals  has  previously  just  been  categorized  as  just  an  unusual  and 
interesting  phenomenon  but  the  work  we've  done  in  the  past  few  years  shows  that 
animals  use  P-vision  in  the  same  way  we  use  colour,  to  communicate  with  each  other.” 

Professor  Marshall  said  ironically  animals  such  as  cephalopods  (cuttlefish,  squid  and 
octopi]  and  many  crustaceans  were  colour  blind.  Instead  they  have  concentrated  on 
polarisation  vision. 

"They  have  evolved  perfectly  to  see  light  we  cannot  see  and  also  use  polarized  skin 
patterns  to  camouflage  into  their  backgrounds,  giving  them  an  advantage  over  some 
predators  who  did  not  have  P-vision. 

"While  colour  is  very  useful  in  terrestrial  or  shallow-water  environments,  it  is  an 
unreliable  cue  deeper  in  water  due  to  the  spectral  modification  of  light  as  it  travels 
through  water  of  various  depths  or  of  varying  optical  quality,"  he  said. 

"Here,  polarization  vision  and  communication  has  special  utility  and  consequently  has 

evolved  in  numerous  marine  species,  as  well  as  at  least  one  terrestrial 

animal." 

Professor  Marshall,  of  UQ's  Queensland  Brain  Institute,  last  year  received  $962,000, 
including  a  Discovery  Outstanding  Researcher  Award  (DORA],  for  a  three-year  study  of 
colour  and  polarization  vision  on  the  Great  Barrier  Reef. 


As  the  tightest-packed  ecosystem  on  the  planet,  coral  reefs  make  for  a  competitive 
environment,  from  which  has  evolved  unique  sensory  adaptations  that  Professor 
Marshall's  research  will  investigate. 

His  laboratory  has  developed  a  range  of  techniques  and  methods,  such  as  underwater 
spectrophotometry,  photography,  unique  behavioural  tests  and  mathematical  modeling 
of  animal  vision  to  understand  the  design  of  visual  signals  and  systems  in  the  light  of 
ecology,  behaviour  and  evolution." 


Polarisation  vision  in  intertidal  crustaceans  -  fiddler  crabs 

Using  a  very  similar  experimental  protocol,  we  investigated  the  polarisation  sense  of 
an  intertidal  crustacean,  the  fiddler  crab  Uca  vomeris.  Because  this  species  normally 
inhabits  intertidal  mudflats  and  is  active  during  the  low-tide  period,  we  could  not  use 
a  standard  aquarium  system.  Instead,  we  suspended  the  crab  on  top  of  a  polystyrene 
ball  supported  over  a  steady  flow  of  compressed  air,  so  that  the  crab  was  able  to 
‘walk’  freely  causing  the  ball  to  rotate  underneath  it.  We  were  then  able  to  present 
polarisation  stimuli  (again  the  predator-like  looming  stimulus)  of  varying  angular 


contrast  to  the  tethered  animal.  The  crabs  responded  to  perceived  looming  stimuli, 
either  by  running  away  from  the  monitor,  or  by  ‘freezing’  (Fig.  2). 

Using  this  system,  we  found  that,  like  the  cephalopods,  fiddler  crabs  are  extremely 
sensitive  (1-3°)  to  the  angular  contrast  of  polarised  light  (Fig.  3).  This  work  has  also 
now  been  published  in  the  leading  scientific  journal,  Journal  of  Experimental 
Biology. 

a)  b) 


camera 


Fig.  2.  Fiddler  crab  ( Uca  vomeris )  running  escape  response  as  a  behavioural  assay  for  testing 
polarisation  vision,  (a)  Schematic  of  testing  running  ball  and  relative  position  and  size  of  stimulus,  fb) 
Direction  of  runs  away  from  polarization  looming  stimulus. 
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Fig.  3.  Response  of  the  fiddler  crab  Uca  vomeris  to  varying  polarisation  angular  contrasts. 


This  behavioural  assay  has  also  been  used  to  test  stomatopod  crustaceans  and  new 
results  confirm  a  very  different  result  to  that  in  cuttlefish  and  fiddler  crabs  in  that 
stomatopods  show  very  coarse  sensitivity  to  polarisation  (Fig.  4) 


Fig.  4.  Response  of  the  stomatopod  (mantis  shrimp)  Haptosquillci  trispinosa  to  varying  polarisation 
angular  contrasts.  Sensitivity  threshold  is  around  15°. 

This  observation  is  in  some  ways  surprising  as  stomatopods  possess  what  appears  to 
be  the  most  complex  polarisation  system  of  animal,  sampling  linear  polarisation  with 
four  channels  and  circular  polarisation  with  two,  but  this  is  consistent  with  one 
current  hypothesis.  That  is  -  both  the  stomatopod  colour  and  polarisation  system  are 
not  interested  in  fine  detail  but  in  fact  seek  rapid  information  through  a  scanning 
visual  system  about  features  in  their  environment.  This  rapid  information  transfer 
through  multiple  serial  channels  is  the  subject  of  a  new  proposal  to  AOARD  and 
AFOSR.  The  finding  has  formed  part  of  a  manuscript  just  submitted  to  the  top 
scientific  journal,  Nature. 


2  -  Anatomy:  a  new  form  of  polariser  (achievement  g) 

One  objective  of  this  project  (Objective  1)  has  been  to  examine  not  just  the  visual 
systems  of  polarisation  sense  but  also  the  ways  in  which  animals  manipulate 
polarised  light.  A  recent  publication  in  The  Journal  of  Experimental  Biology  (Fig.  5 
front  cover)  details  this  work.  This  Chiou  et  al  paper  is  also  attached  with  this  report. 


The  Journal  of 


Experimental 


Fig.  5.  A  new  type  of  polariser  to  nature  was  described  from  the  antennal  scales  in  stomatopod 
Odontodactylus  scyllarus. 

Biological  signals  based  on  color  patterns  are  well  known,  but  some  animals 
communicate  by  producing  patterns  of  polarized  light.  Known  biological  polarizers 
are  all  based  on  physical  interactions  with  light  such  as  birefringence,  differential 
reflection,  or  scattering.  We  describe  a  novel  biological  polarizer  in  a  marine 
crustacean  based  on  linear  dichroism  of  a  carotenoid  molecule.  The  red-colored, 
dichroic  ketocarotenoid  pigment  astaxanthin  is  deposited  in  the  antennal  scale  of  a 
stomatopod  crustacean,  Odontodactylus  scyllarus.  Positive  correlation  between 
partial  polarization  and  the  presence  of  astaxanthin  indicates  that  the  antennal  scale 
polarizes  light  with  astaxanthin.  Both  the  optical  properties  and  the  fine  structure  of 
the  polarizationally-active  cuticle  suggest  that  the  dipole  axes  of  the  astaxanthin 
molecules  are  oriented  nearly  normal  to  the  antennal  scale’s  surface.  While  dichroic 


retinoids  are  used  as  visual  pigment  chromophores  to  absorb  and  detect  polarized 
light,  this  is  the  first  demonstration  of  the  use  of  a  carotenoid  to  produce  a  polarizing 
signal.  By  using  the  intrinsic  dichroism  of  the  carotenoid  molecule  and  orienting  the 
molecule  in  tissue,  nature  has  engineered  a  previously  undescribed  form  of  biological 
polarizer. 


3  -  Polarising  reflections  from  marine  creatures  other  than  cephalopods  and 
stomatopods  (achievement  h) 

While  there  is  good  evidence  for  specific  polarisation  reflections  from  both 
stomatopods  and  cephalopods.  It  is  worth  asking  what  these  polarisation  vision 
capable  animals  would  see  if  they  viewed  other  species.  Is  there  a  predatory 
advantage?  Are  there  animals  that  ‘know  through  evolution’  that  they  must  respond 
to  this  threat  and  camouflage  in  polarisation  against  their  backgrounds? 

Research  from  previous  AOARD  contracts  (Contract  -  064040)  in  which  a  polarising 
camera  system  was  developed  to  characterise  polarisation  from  animals  in  situ,  has 
revealed  both  camouflage  and  also  potential  vulnerability  in  marine  animals  (Fig.  6). 
There  are  a  number  of  examples  of  camouflage  breaking  that  polarisation  vision 
gives  that  were  previously  unexpected: 


Fig.  6  The  world’s  first  real  time  polarising  video  camera  and  underwater  housing.  The  bottom  panel 
shows  computed  false-colour  output  in;  intensity,  degree  of  polarization  and  angle  of  polarization. 
Scales  for  degree  and  angle  from  0-100%  and  angles  as  encoded  around  colour  circle.  Note  how  this 
well  camouflaged  silvery  fish  is  not  well  camouflaged  in  polarization  degree.  A  stream  of  information 
available  to  predators  such  as  squid  and  crustaceans. 


Most  remarkable  in  these  observations  are  firstly  the  close  match  to  the  background 
that  silvery  fish  manage  in  polarization  angle  only.  They  are  poor  at  matching  degree 
of  polarization  and  this  work  has  been  the  subject  of  a  Nature  publication  from  the 
laboratory  of  Nick  Roberts.  Using  the  new  generation  of  polarization  we  are  now 
beginning  to  understand  this  covert  communication  channel  and  look  for  animals  that 
have,  through  evolution,  ‘known’  about  the  advantages  and  disadvantages  of  this 
communication  medium. 


Future  directions 


As  this  project  has  now  finished,  as  mentioned,  we  have  just  begun  the  next  stage, 
building  upon  the  results  from  the  last  three  years.  Below  is  a  summary  of  the 
proposal  just  underway.  This  is  an  attempt  at  re-building  the  stomatopod  eye  (Fig.  8) 
and  understand  some  of  the  information  transfer  principles  behind  this  remarkable 
system. 


Re-engineering  the  stomatopod  eye,  nature's  most  comprehensive  visual  sensor 
ABSTRACT 

Stomatopod  (mantis  shrimp)  vision  is  both  unique  among  animals  and 
extraordinarily  complex  at  the  receptor  level,  comprising  a  total  of  20  different 
photoreceptor  types  or  functional  input  channels.  12  channels  for  color  (including 
several  in  the  UV,  the  whole  system  sampling  from  300-720nm),  6  for  linear 
polarization  (4  sampling  at  0°,  90°, 45°  and  135°)  with  peak  spectral  sensitivity  close 
to  500nm  and  2  in  the  UV  sampling  at  0°  and  90°,  with  peak  spectral  sensitivity 
close  to  350nm)  and  (in  some  species),  2  for  circular  polarization  (Left  and 
Right-handed),  also  with  peak  spectral  sensitivity  close  to  500nm.  Why  do 
stomatopods  sample  the  light  that  is  available  to  them  in  such  great  detail? 

This  research  project  builds  on  our  previous  work  in  this  system  and  with  a 
combination  of  our  current  state  of  knowledge  and  fresh  intellectual  and  meth 
odological  input  to  the  project,  aims  to  explain  the  complexity  of  the  system 
for  the  first  time.  Stomatopods  brains  are  small  and  are  unlikely  to  deal  in  m 
ulti-dimensional  data  sets  but,  in  common  with  most  invertebrates,  more  likely 
send  a  set  of  simple  ‘command  messages’  to  the  brain  from  the  eye  and  out 
er  visual  system  neuropils.  The  mechanisms  that  function  to  reduce  and  analys 
e  the  complexity  of  20  data  streams  make  up  an  important  component  of  the 
research  we  propose  here.  Added  leverage  to  approach  both  receptor  function 
and  data  streaming  /  filtering  comes  from  new  collaborations  that  can  mimic 
or  re-engineer  the  stomatopod  eye  opto-electronically.  By  sharing  coding  princi 
pies  between  disciplines  (engineering  and  biology),  and  through  continued  beha 
vioural,  anatomical,  molecular  and  physiological  investigations,  we  aim  to  deco 
de  the  inner  principles  of  stomatopod  vision  as  well  as  provide  spin-offs  to  in 
form  more  efficient  and  smart  sensor  design. 


STATEMENT  OF  OBJECTIVES 


The  proposed  research  represents  an  unusually  integrative  effort,  bringing  together 
four  world-class  laboratories  -  two  headed  by  senior  scientists  with  years  of 
collaborative  experience  and  two  by  up-and-coming  junior  scientists  with  whom  we 
have  worked  in  recent  years.  The  team  provides  strength  in  diverse  areas  of 
research,  from  molecular  genetics  and  cell  biology  to  advanced  imaging  and 
spectral/polarization  analysis  of  scenes  and  living  organisms,  to  optics  and 
optoelectronics,  to  fabrication  of  nanodevices,  photosensors,  and  real-time  analytical 
systems.  The  research  will  use  basic  biological  investigation  of  the  most  complex 
visual  sensory  analyser  yet  found,  that  of  stomatopod  crustaceans,  to  leam 
fundamental  processes  of  sensory  analysis  and  neural  integration  and  to  use  these 
findings  to  inspire  the  design  of  new  types  of  imaging  devices  and  analysers. 

Specific  objectives  are: 

(1)  To  learn  the  design  foundations  stomatopods  use  for  optimized,  rapid 
processing  of  multi-channel  information.  We  will  examine  the  limits  of  resolution 
polarization  vision  in  stomatopods,  using  new  methods  of  presenting  stimuli  that 
provide  precise  tuning  of  stimulus  polarization  angle,  degree  and  ellipticity.  Similar 
approaches  permit  us  to  explore  spectral  resolution  and  see  further  through  scattering 
media.  Central  to  this  objective  is  discovering  how  stomatopods  scanning  eye 
behaviour  organizes  and  inputs  multi-channel  spatiotemporal  information. 

(2)  To  discover  how  information  is  processed  in  stomatopod  visual  systems. 

At  the  most  fundamental  level  we  will  undertake  studies  of  the  molecular  and 
cellular  basis  of  rapid  photoreception  and  phototransduction  (by  examining  the  genes 
and  cytoskeletal  elements  of  mantis  shrimp  receptors).  At  higher  levels,  we  will 
examine  neural  interconnectivity  and  processing  principles  at  various  stages  of 
analysis  in  the  visual  system  both  anatomically  and  with  electrophysiological 
approaches. 

(3)  To  discover  the  natural  complexity  of  visual  scenes  the  stomatopod  imaging 
system  has  evolved  to  see.  It  is  fundamental  that  we  understand  the  visual 
information  stomatopods  see.  This  crucial  component  of  the  project  takes  findings 
generated  by  the  above-stated  objectives,  with  inspiration  from  our  earlier  work  as 
well,  to  inform  the  design  of  artificial  stomatopod  inspired  imaging  devices.  Our 
findings  related  to  camouflage  patterns  or  biological  communication  systems  will 
inspire  future  image  analysis  of  natural  and  machine  vision  environments. 

(4)  To  investigate  the  co-evolution  of  visual  systems,  visual  signals  and 
camouflage  in  the  natural  environment.  We  will  proceed  from  the  above 
discoveries  to  relate  how  stomatopods  see  and  what  they  see  to  our  observations  that 
species  vary  in  the  types  of  signals  they  produce  (including  spectral,  polarization, 
circular  polarization,  and  temporal  motion  features).  We  will  examine  whether 


polarization  signals  are  matched  to  properties  of  the  polarization  receptors  among 
species,  and  detail  the  evolutionary  paths  of  the  optical  devices  in  stomatopod  eyes, 
polarization  sensitivity  and  polarization  signals. 
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Fig.  7  The  stomatopod  eye,  biological  and  engineered. 

a-c)  Views  at  increasing  magnifications  of  the  stomatopod  eye,  showing  the  mid-band  and 
surrounding  peripheral  retina.  In  (c),  the  overlays  show  the  task  of  each  part  of  the  eye:  Color 
processing  occurs  in  12  channels  by  mid-band  rows  1-4,  where  each  row  has  a  3-channel,  stacked 
spectral  analysis  set.  The  dorsal  peripheral  region  examines  two  different  e-vectors  at  ±45°,  while  the 
ventral  periphery,  analyzes  e-vectors  that  are  horizontal  and  vertical.  Rows  5&6  in  the  mid-band 
examine  circularly  polarized  light  (in  some  species).  These  polarization  components  are  copied  from 
Fig.  4.1  in  “Fundamentals  of  Polarimetric  Remote  Sensing”  by  John  R  Schott,  and  represent  the  filters 
used  to  characterize  the  Stokes  vector.  This  illustration  in  Schott’s  book  was  produced  with  no 


knowledge  of  or  connection  with  stomatopod  vision.  Here  precisely  the  same  diagrams  can  be  used  to 
represent  the  underlying  anatomy  and  polarization  function  of  the  stomatopod  eye -region,  d)  The 
proposed  design  of  the  re-engineered  stomatopod  eye  at  the  level  of  the  chip.  Each  symbol  represents 
a  nano-engineered  pixel  containing  polarization  and  color  information  (in  some  simultaneously).  This 
technology  already  exists  within  the  Gruev  lab,  but  has  yet  to  be  applied  in  an  actual  imaging  system. 
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